Modular processing of magnetic resonance data

ABSTRACT

The invention provides for medical instrument ( 800, 1000 ) comprising a magnetic resonance imaging system. Execution of the instruction cause a processor controlling the instrument to: execute ( 900 ) a magnetic resonance data processing application ( 42, 852 ) thereby providing a plug-in framework, execute ( 902 ) a protocol definition interface to load a first selection ( 858 ) of the plug-ins into the plug-in framework, acquire ( 904 ) the magnetic resonance data by using the pulse sequence data to control the magnetic resonance imaging system; and reconstruct ( 906 ) a magnetic resonance image from the magnetic resonance data using the first selection of the plug-ins.

CROSS-REFERENCE TO PRIOR APPLICATIONS

This application claims the benefit of U.S. Provisional PatentApplication No. 61/807,794, filed on Apr. 3, 2013. This application ishereby incorporated by reference herein.

TECHNICAL FIELD

The invention relates to magnetic resonance imaging, in particular tothe reconstruction of magnetic resonance images and to magneticresonance imaging guided therapy.

BACKGROUND OF THE INVENTION

The Magnetic Resonance (MR) Scanner is typically connected to a computeror workstation, which is used to obtain process and store image datawhich can be processed and displayed as images. The image data iscaptured as raw data (k-space data or magnetic resonance data) thatcontains artifacts inherent to the scanner.

During MR reconstruction (when the patient is in the scan room), the rawimage data (k-space data) undergoes a set of transformations to convertthe images in k-space to image space (spatial domain) before they aredisplayed on a monitor. The medical professional then reviews the imagesfor a patient or saves the images and recalls them later for morediagnosis.

Image processing algorithms are applied to the raw image data to convertthem from k-space to image space so that it can be viewed, analyzed anddiagnosed by the medical professional. There are many image processingalgorithms that add diagnostic value to these images. Image processingis a research field in itself, with many algorithms of high diagnosticvalue being continually developed. New image processing algorithms areoften developed and integrated into the reconstruction chain.

The image processing steps that needs to be applied depends on the scantype (like Spin Echo scan, Gradient Echo scan, SENSE scan, Dixon scanetc). Currently as the scan time of MR scanner is considerably highthere is continuous research going on to come up with new scan typewhich would reduce the scan time. Often whenever a new scan type isintroduced it would warrant for a new image processing algorithm inreconstruction chain.

For fast execution of image reconstruction the computer resources likethe CPU (cores), memory will have to be used judiciously andefficiently.

Currently MR image reconstruction is developed as a monolithic andclosed package in a programming language like C++ without the clearseparation of mathematical numerical processing and software engineeringdisciplines. This application is compiled for distribution to customerswho purchase, lease or own the MR Scanner. Integration of new algorithmsrequires recompiling the application software. Also the number ofthreads to be used by the application is hardcoded in the application.The off-the-shelf libraries used are hardcoded in the code and anychange in the library needs code modification and recompilation of theapplication software.

United States patent application US 2005/0018929 A1 discloses a methodfor dynamically editing and enhancing image-processing chains in medicalimaging equipment.

SUMMARY OF THE INVENTION

The invention provides for a medical instrument, a computer programproduct and a method in the independent claims. Embodiments are given inthe dependent claims.

As will be appreciated by one skilled in the art, aspects of the presentinvention may be embodied as an apparatus, method or computer programproduct. Accordingly, aspects of the present invention may take the formof an entirely hardware embodiment, an entirely software embodiment(including firmware, resident software, micro-code, etc.) or anembodiment combining software and hardware aspects that may allgenerally be referred to herein as a “circuit,” “module” or “system.”Furthermore, aspects of the present invention may take the form of acomputer program product embodied in one or more computer readablemedium(s) having computer executable code embodied thereon.

Any combination of one or more computer readable medium(s) may beutilized. The computer readable medium may be a computer readable signalmedium or a computer readable storage medium. A ‘computer-readablestorage medium’ as used herein encompasses any tangible storage mediumwhich may store instructions which are executable by a processor of acomputing device. The computer-readable storage medium may be referredto as a computer-readable non-transitory storage medium. Thecomputer-readable storage medium may also be referred to as a tangiblecomputer readable medium. In some embodiments, a computer-readablestorage medium may also be able to store data which is able to beaccessed by the processor of the computing device. Examples ofcomputer-readable storage media include, but are not limited to: afloppy disk, a magnetic hard disk drive, a solid state hard disk, flashmemory, a USB thumb drive, Random Access Memory (RAM), Read Only Memory(ROM), an optical disk, a magneto-optical disk, and the register file ofthe processor. Examples of optical disks include Compact Disks (CD) andDigital Versatile Disks (DVD), for example CD-ROM, CD-RW, CD-R, DVD-ROM,DVD-RW, or DVD-R disks. The term computer readable-storage medium alsorefers to various types of recording media capable of being accessed bythe computer device via a network or communication link. For example adata may be retrieved over a modem, over the internet, or over a localarea network. Computer executable code embodied on a computer readablemedium may be transmitted using any appropriate medium, including butnot limited to wireless, wireline, optical fiber cable, RF, etc., or anysuitable combination of the foregoing.

A computer readable signal medium may include a propagated data signalwith computer executable code embodied therein, for example, in basebandor as part of a carrier wave. Such a propagated signal may take any of avariety of forms, including, but not limited to, electro-magnetic,optical, or any suitable combination thereof. A computer readable signalmedium may be any computer readable medium that is not a computerreadable storage medium and that can communicate, propagate, ortransport a program for use by or in connection with an instructionexecution system, apparatus, or device.

‘Computer memory’ or ‘memory’ is an example of a computer-readablestorage medium. Computer memory is any memory which is directlyaccessible to a processor. ‘Computer storage’ or ‘storage’ is a furtherexample of a computer-readable storage medium. Computer storage is anynon-volatile computer-readable storage medium. In some embodimentscomputer storage may also be computer memory or vice versa.

A ‘processor’ as used herein encompasses an electronic component whichis able to execute a program or machine executable instruction orcomputer executable code. References to the computing device comprising“a processor” should be interpreted as possibly containing more than oneprocessor or processing core. The processor may for instance be amulti-core processor. A processor may also refer to a collection ofprocessors within a single computer system or distributed amongstmultiple computer systems. The term computing device should also beinterpreted to possibly refer to a collection or network of computingdevices each comprising a processor or processors. The computerexecutable code may be executed by multiple processors that may bewithin the same computing device or which may even be distributed acrossmultiple computing devices.

Computer executable code may comprise machine executable instructions ora program which causes a processor to perform an aspect of the presentinvention. Computer executable code for carrying out operations foraspects of the present invention may be written in any combination ofone or more programming languages, including an object orientedprogramming language such as Java, Smalltalk, C++ or the like andconventional procedural programming languages, such as the “C”programming language or similar programming languages and compiled intomachine executable instructions. In some instances the computerexecutable code may be in the form of a high level language or in apre-compiled form and be used in conjunction with an interpreter whichgenerates the machine executable instructions on the fly.

The computer executable code may execute entirely on the user'scomputer, partly on the user's computer, as a stand-alone softwarepackage, partly on the user's computer and partly on a remote computeror entirely on the remote computer or server. In the latter scenario,the remote computer may be connected to the user's computer through anytype of network, including a local area network (LAN) or a wide areanetwork (WAN), or the connection may be made to an external computer(for example, through the Internet using an Internet Service Provider).

Aspects of the present invention are described with reference toflowchart illustrations and/or block diagrams of methods, apparatus(systems) and computer program products according to embodiments of theinvention. It will be understood that each block or a portion of theblocks of the flowchart, illustrations, and/or block diagrams, can beimplemented by computer program instructions in form of computerexecutable code when applicable. It is further understood that, when notmutually exclusive, combinations of blocks in different flowcharts,illustrations, and/or block diagrams may be combined. These computerprogram instructions may be provided to a processor of a general purposecomputer, special purpose computer, or other programmable dataprocessing apparatus to produce a machine, such that the instructions,which execute via the processor of the computer or other programmabledata processing apparatus, create means for implementing thefunctions/acts specified in the flowchart and/or block diagram block orblocks.

These computer program instructions may also be stored in a computerreadable medium that can direct a computer, other programmable dataprocessing apparatus, or other devices to function in a particularmanner, such that the instructions stored in the computer readablemedium produce an article of manufacture including instructions whichimplement the function/act specified in the flowchart and/or blockdiagram block or blocks.

The computer program instructions may also be loaded onto a computer,other programmable data processing apparatus, or other devices to causea series of operational steps to be performed on the computer, otherprogrammable apparatus or other devices to produce a computerimplemented process such that the instructions which execute on thecomputer or other programmable apparatus provide processes forimplementing the functions/acts specified in the flowchart and/or blockdiagram block or blocks.

A ‘user interface’ as used herein is an interface which allows a user oroperator to interact with a computer or computer system. A ‘userinterface’ may also be referred to as a ‘human interface device.’ A userinterface may provide information or data to the operator and/or receiveinformation or data from the operator. A user interface may enable inputfrom an operator to be received by the computer and may provide outputto the user from the computer. In other words, the user interface mayallow an operator to control or manipulate a computer and the interfacemay allow the computer indicate the effects of the operator's control ormanipulation. The display of data or information on a display or agraphical user interface is an example of providing information to anoperator. The receiving of data through a keyboard, mouse, trackball,touchpad, pointing stick, graphics tablet, joystick, gamepad, webcam,headset, gear sticks, steering wheel, pedals, wired glove, dance pad,remote control, and accelerometer are all examples of user interfacecomponents which enable the receiving of information or data from anoperator.

A ‘hardware interface’ as used herein encompasses an interface whichenables the processor of a computer system to interact with and/orcontrol an external computing device and/or apparatus. A hardwareinterface may allow a processor to send control signals or instructionsto an external computing device and/or apparatus. A hardware interfacemay also enable a processor to exchange data with an external computingdevice and/or apparatus. Examples of a hardware interface include, butare not limited to: a universal serial bus, IEEE 1394 port, parallelport, IEEE 1284 port, serial port, RS-232 port, IEEE-488 port, Bluetoothconnection, Wireless local area network connection, TCP/IP connection,Ethernet connection, control voltage interface, MIDI interface, analoginput interface, and digital input interface.

A ‘display’ or ‘display device’ as used herein encompasses an outputdevice or a user interface adapted for displaying images or data. Adisplay may output visual, audio, and or tactile data. Examples of adisplay include, but are not limited to: a computer monitor, atelevision screen, a touch screen, tactile electronic display, Braillescreen, Cathode ray tube (CRT), Storage tube, Bistable display,Electronic paper, Vector display, Flat panel display, Vacuum fluorescentdisplay (VF), Light-emitting diode (LED) displays, Electroluminescentdisplay (ELD), Plasma display panels (PDP), Liquid crystal display(LCD), Organic light-emitting diode displays (OLED), a projector, andHead-mounted display.

Magnetic Resonance (MR) data is defined herein as being the recordedmeasurements of radio frequency signals emitted by atomic spins by theantenna of a Magnetic resonance apparatus during a magnetic resonanceimaging scan. Magnetic resonance data is an example of medical imagedata. A Magnetic Resonance Imaging (MRI) image is defined herein asbeing the reconstructed two or three dimensional visualization ofanatomic data contained within the magnetic resonance imaging data. Thisvisualization can be performed using a computer. Magnetic resonance datacan also be referred to as k-space data.

Magnetic Resonance (MR) thermometry data is defined herein as being therecorded measurements of radio frequency signals emitted by atomic spinsby the antenna of a Magnetic resonance apparatus during a magneticresonance imaging scan which contains information which may be used formagnetic resonance thermometry. Magnetic resonance thermometry functionsby measuring changes in temperature sensitive parameters. Examples ofparameters that may be measured during magnetic resonance thermometryare: the proton resonance frequency shift, the diffusion coefficient, orchanges in the T1 and/or T2 relaxation time may be used to measure thetemperature using magnetic resonance. The proton resonance frequencyshift is temperature dependent, because the magnetic field thatindividual protons, hydrogen atoms, experience depends upon thesurrounding molecular structure. An increase in temperature decreasesmolecular screening due to the temperature affecting the hydrogen bonds.This leads to a temperature dependence of the proton resonant frequency.

An ‘ultrasound window’ as used herein encompasses a window which is ableto transmit ultrasonic waves or energy. Typically a thin film ormembrane is used as an ultrasound window. The ultrasound window may forexample be made of a thin membrane of BoPET (Biaxially-orientedpolyethylene terephthalate).

In one aspect the invention provides for a medical instrument comprisinga magnetic resonance imaging system for acquiring magnetic resonancedata from an imaging zone. The medical instrument further comprises amemory containing machine-executable instructions, a magnetic resonancedata processing application, pulse sequence data, at least one numericalalgorithm library, a plug-in wrapper library configured for providingthe at least one numerical algorithm library as plug-ins, and a protocoldefinition interface. The magnetic resonance data processing applicationis an application which enables the processor to process or reconstructmagnetic resonance data and turn it into other forms such as a magneticresonance image. The protocol definition interface is an executableprogram which is configured for controlling the loading of plug-ins andthe execution order of the plug-ins. A numerical algorithm library asused herein encompasses executable computer code for providingimplementations of one or more numerical algorithms. The plug-in wrapperlibrary is software which is used for providing an algorithm or functionin the at least one numerical algorithm library as a plug-in to make itavailable to the magnetic resonance data processing application.

The medical instrument further comprises at least one processor forcontrolling the medical instrument. Execution of the instructions causesthe processor to execute the magnetic resonance data processingapplication thereby providing a plug-in framework. A plug-in as usedherein encompasses a software component which may be used to add aspecific feature or to extend another software application. In thisexample the magnetic resonance data processing application is extendedby the use of plug-ins. The plug-in framework from the magneticresonance data processing application provides a framework or interfacefor plug-ins used to provide the extension to the magnetic resonancedata processing application.

Execution of the instructions further causes the at least one processorto execute the protocol definition interface to load a first selectionof the plug-ins into the plug-in framework. For example for a particularmagnetic resonance protocol one may desire a certain combination ofimage processing or data manipulation plug-ins. The protocol definitioninterface loads a first selection of the plug-ins into the plug-inframework. Execution of the instructions cause the at least oneprocessor to further acquire the magnetic resonance data by using thepulse sequence data to control the magnetic resonance imaging system.Pulse sequence data as used herein encompasses commands that theprocessor can use or data which may be transformed into commands forcontrolling the magnetic resonance imaging system to acquire themagnetic resonance data. Execution of the instructions further cause theat least one processor to reconstruct a magnetic resonance image fromthe magnetic resonance data using the first selection of the plug-ins.In this example the post-processing of the magnetic resonance data wasperformed using the plug-ins. This may enable a more flexible means ofupdating or modifying the functionality of the magnetic resonanceimaging system.

A drawback of current approach for image processing chains or k-spacedata processing chains in medical imaging systems includes:

a. The image processing developers in MR are generally domain expertslike physicists who are not well versed with software engineeringconcepts like threading, task based programming, memory management etc.,and hence are not able to efficiently develop new algorithms.

b. As the image processing chains are done thread based programming(with number of threads predetermined) and not task based approach theapplication doesn't scale with the hardware.

c. It may not be possible to take advantage of the GPU processing power.

d. To update the current image processing chains it may be necessary toupdate and reinstall the imaging application software to add even asingle new image processing algorithm. Another technical problem arisesin integrating new image data processing algorithms, because these areoften developed by third parties at different geographical location.

Examples may provide a means for solving one or more the above mentionedproblems.

In another embodiment the medical instrument further comprises atreatment system for directing energy at a target zone within theimaging zone. The energy may for instance be acoustic energy or it maybe heat, or it may be ionizing radiation from, for example a gamma orX-ray source. Execution of the instructions further cause the processorto receive treatment plan data descriptive of commands for controllingthe treatment system to direct energy at the target zone. Execution ofthe instructions further cause the protocol definition interface tofurther load a second selection of the plug-ins operable for generatingtreatment system control commands using the magnetic resonance image andthe treatment plan data.

The second selection of plug-ins are used as part of a control systemfor the treatment system. Execution of the instructions further causethe processor to repeatedly acquire the magnetic resonance data andreconstruct the magnetic resonance image using the first selection ofthe plug-ins. That is to say the magnetic resonance data is repeatedlyacquired and the image is repeatedly reconstructed from the acquireddata. Next execution of the instructions further cause the at least oneprocessor to repeatedly generate the treatment system control commandsusing the second selection of the plug-ins.

Execution of the instructions further cause the processor to repeatedlycontrol the treatment system using the treatment system controlcommands. The second selections of the plug-ins are used to process themagnetic resonance image and the treatment plan data to directlygenerate commands for controlling the treatment system. In this examplethe first selection of the plug-ins and the second selection of theplug-ins are used in a control loop for controlling the treatment systemin response to the repeatedly acquired magnetic resonance data. The useof the plug-ins provides for a more flexible and extensible system forthe control of the treatment system.

In another embodiment the treatment system is a high-intensity focusedultrasound system.

In another embodiment the magnetic resonance imaging image comprises atemperature map. The temperature map may for instance be used formeasuring the heating of the subject by the high-intensity focusedultrasound system in real time and then uses as feedback for generatingthe treatment control commands. This may result in more accurate heatingof the target zone by the high-intensity focused ultrasound system.

In another embodiment the treatment system is an external beamradiotherapy system for irradiating the target zone with a beam ofionizing radiation. The magnetic resonance image for instance could beused for tracking the external and/or internal motion of the subject.The magnetic resonance images acquired could therefore be used to moreaccurately target the target zone with the beam of ionizing radiation.

In another embodiment the external beam radiotherapy system is a gammaknife.

In another example the external beam radiotherapy system is a LINAC.

In another embodiment the external beam radiotherapy system is an x-raytreatment system.

In another embodiment the external beam radiotherapy system is a chargedparticle accelerator.

In another embodiment the at least one processor is two or moreprocessors operable for executing multiple processor threads. Executionof the instructions causes the processor to execute the plug-ins usingthe multiple processor threads.

In another embodiment the medical instrument further comprises at leastone graphics processor. The magnetic resonance data processingapplication is configured for executing at least a portion of theplug-ins using at least one graphics processor.

In another embodiment the at least one numerical algorithm library is atleast two numerical algorithm libraries. Each of the at least twonumerical algorithm libraries is implemented in a different programminglanguage.

In another embodiment the protocol definition interface is configuredfor controlling the loading of the plug-ins and the execution order ofthe plug-ins using a script. For instance the protocol definitioninterface could refer to or have commands executed by the script whichcause the plug-ins to be loaded into the plug-in framework.

In another embodiment the pulse sequence data comprises additional datasuch as the script for controlling the protocol definition interface. Inother examples the inclusion of the pulse sequence data of the script isby having a logical link in the pulse sequence data which points oridentifies the proper script.

Having the pulse sequence data somehow access the script may bebeneficial because it enables the proper pulse sequence to be linked oraccess the appropriate plug-ins for processing the data.

In another aspect the invention provides for a computer program productcomprising machine-executable instructions for execution by at least oneprocessor controlling the medical instrument. The medical instrumentcomprises a magnetic resonance imaging system for acquiring magneticresonance data from an imaging zone. The medical instrument furthercomprises a memory containing; a magnetic resonance data processingapplication, pulse sequence data, at least one numerical algorithmlibrary, a plug-in wrapper library configured for providing the at leastone numerical algorithm library as plug-ins, and a protocol definitioninterface.

The at least one numerical algorithm library comprisesmachine-executable code for performing at least one numerical algorithm.The magnetic resonance data processing application is configured forimplementing a plug-in framework for a numerical processing of themagnetic resonance data. The protocol definition interface is configuredfor controlling the loading of the plug-ins and the execution order ofthe plug-ins. Execution of the machine-executable instructions cause theat least one processor to execute the magnetic resonance data processingapplication thereby providing a plug-in framework. Execution of themachine-executable instructions further causes at least one processor toexecute the protocol definition interface to load a first selection ofthe plug-ins into the plug-in framework.

Execution of the machine-executable instructions further causes the atleast one processor to acquire the magnetic resonance data by using thepulse sequence data to control the magnetic resonance imaging system.Execution of the machine-executable instructions further cause the atleast one processor to reconstruct a magnetic resonance image from themagnetic resonance data using the first selection of the plug-ins.

In another embodiment the medical instrument further comprises atreatment system for directing energy at a target zone within theimaging zone. Execution of the instructions further cause the processorto receive treatment plan data descriptive of commands for controllingthe treatment system to direct energy at the target zone. Execution ofthe protocol definition interface further loads a second selection ofthe plug-ins operable for generating treatment system control commandsusing the magnetic resonance image and the treatment plan data.Execution of the machine-executable instructions further cause the atleast one processor to repeatedly acquire the magnetic resonance dataand reconstruct the magnetic resonance image using the first selectionof the plug-ins. Execution of the instructions further cause the atleast one processor to repeatedly generate the treatment system controlcommands using the second selection of the plug-ins. Execution of theinstructions further cause the at least one processor to repeatedlycontrol the treatment system using the treatment system controlcommands.

In another aspect the invention provides for a method of operating themedical instrument comprising the magnetic resonance imaging system foracquiring magnetic resonance data from an imaging zone. The medicalinstrument further comprises a memory containing: a magnetic resonancedata processing application, pulse sequence data, at least one numericalalgorithm library, a plug-in wrapper library configured for providingthe at least one numerical algorithm library as plug-ins, and a protocoldefinition interface. The at least one numerical algorithm librarycomprises machine-executable code for performing at least one numericalalgorithm.

The magnetic resonance data processing application is configured forimplementing a plug-in framework for numerical processing of themagnetic resonance data. The protocol definition interface is configuredfor controlling the loading of the plug-ins and the execution order ofthe plug-ins. The method comprises the step of executing the magneticresonance data processing application thereby providing a plug-inframework. The method further comprises the step of executing theprotocol definition interface to load a first selection of the plug-insinto the plug-in framework. The method further comprises the step ofacquiring the magnetic resonance data by using the pulse sequence datato control the magnetic resonance imaging system. The method furthercomprises the step of reconstructing the magnetic resonance image fromthe magnetic resonance data using the first selection of the plug-ins.

In another embodiment the medical instrument further comprises atreatment system for directing energy at a target zone within theimaging zone. The method further comprises receiving treatment plan datadescriptive of commands for controlling the treatment system to directenergy at the target zone. The method further comprises using theprotocol definition interface to further load a second selection ofplug-ins operable for generating treatment system control commands usingthe magnetic resonance image and the treatment plan data. The methodfurther comprises the step of repeatedly acquiring the magneticresonance data and reconstructing the magnetic resonance image using theselection of the plug-ins. The method further comprises the step ofgenerating the treatment system control commands using the secondselection of the plug-ins. The method further comprises the step ofrepeatedly controlling the treatment system using the treatment systemcontrol commands.

Embodiments may provides a method of adding new algorithm/processingstep developed in any programming language (like MATLAB) to existingreconstruction chains without the need for recompiling the applicationsoftware. Embodiments may also provides a method to use and changeoff-the-shelf mathematical libraries at runtime without the need forrecompiling the application software.

Embodiments may allows usage of GPU libraries like NPP, CUDA which wouldrun mathematical/signal processing routines on GPU if available on thesystem and thus improve the performance of the image processing chain.

Embodiments may enable the separation of mathematical numericalprocessing and software engineering disciplines and thus enables thefast research/development of new algorithms.

Embodiments may allow the research scientists in radiology field indeveloping new algorithms in their favorite language and using on thescanner without requiring a recompilation of the application software.

Embodiments may allow scaling the magnetic resonance data processingapplication with the hardware improvements and hence enable more scansto be performed per day.

Embodiments may allows the medical professional such as radiologist tocustomize the magnetic resonance data processing application used in thescanner without requiring a software update or reinstallation andwithout calling the service engineer.

Embodiments may use an interpreted language for linking and sequencingthe image processing elements within image-processing chains, so thatthe chain can be changed dynamically.

It is understood that one or more of the aforementioned embodiments ofthe invention may be combined as long as the combined embodiments arenot mutually exclusive.

BRIEF DESCRIPTION OF THE DRAWINGS

In the following preferred embodiments of the invention will bedescribed, by way of example only, and with reference to the drawings inwhich:

FIG. 1 flow chart illustrating a data processing chain;

FIG. 2 shows a high level implementation of an image or data processingapplication;

FIG. 3 illustrates various operations performed by plug-ins or nodes;

FIG. 4 illustrates a node and shows how it is designed to implement analgorithm;

FIG. 5 illustrates how algorithms developed in other languages can behandled;

FIG. 6 illustrates the design of a library module;

FIG. 7 illustrates the execution of a reconstructor chain using a threadpool on a multi-core processor computer;

FIG. 8 illustrated an example of a medical instrument;

FIG. 9 shows a block diagram which illustrates a method of operating themedical instrument of FIG. 8;

FIG. 10 illustrates a further example of a medical instrument;

FIG. 11 shows a block diagram which illustrates a method of operatingthe medical instrument of FIG. 10;

FIG. 12 illustrates a framework for implementing a magnetic resonancedata processing system;

FIG. 13 shows a flowchart which illustrates a method of adding a newnode or plug-in to the framework of FIG. 12;

FIG. 14 shows a reconstruction graph or the sequence is used toreconstruct a magnetic resonance image for a diagnostic magneticresonance imaging system; and

FIG. 15 shows how the sequence of FIG. 14 may be modified forcontrolling a magnetic resonance imaging system.

DETAILED DESCRIPTION OF THE EMBODIMENTS

Like numbered elements in these figures are either equivalent elementsor perform the same function. Elements which have been discussedpreviously will not necessarily be discussed in later figures if thefunction is equivalent.

FIG. 1 shows an example of an image or data processing chain 1. Theimage or data processing chain may also be referred to as areconstructor. A raw image 2 is fed into the chain 1 and a processedimage 3 is received at the end of the chain. In this example there arefour algorithms 4, 5, 6, 7 shown in the chain. A algorithm used 4, 5, 6,7 in a chain 1 may be referred to as a node.

As stated above, FIG. 1 illustrates a simple MR image reconstructionchain 1. The blocks 4, 5, 6, 7 in the reconstruction chain 1 are appliedto the raw imaging data 2 to produce a processed image 3. These processblocks each include a respective algorithm which is executed when thisblock of the computer program is executed.

As seen from FIG. 1 the processed images are generated after applying asequence of transformations or algorithms (represented as blocks) to theraw image data. These blocks (hereafter referred as “Nodes” in thisdocument) are generic. The invention provides an efficient, flexible andopen architecture for execution of the reconstruction chain. FIG. 2illustrates the high level architecture of the system of FIG. 1.

FIG. 2 shows a high level implementation 8 of the magnetic resonancedata processing application. The magnetic resonance data processingapplication is shown as having an implementation of a nodeinfrastructure or plug-in framework. The algorithms 9, 10 and 11 can beseen as interfacing with the plug-in framework. The system alsocomprises a numerical library 12 which can be used by the algorithms 9,10, 11. IPP, MKL, and NPP refer to different numerical libraries thatare available.

Within the magnetic resonance data processing application there arecomponents for doing the configuration of the algorithms 9, 10, 11, athread pool management 14, and a memory manager 15.

Here the domain/mathematics and the software engineering concepts areseparated. The software engineering part like the threading, memorymanagement, configuration support is handled by the platform 8. Theplatform 8 also provides the node infrastructure, which is the genericpart of all Nodes. The node infrastructure may also be referred to as aplug-in framework and the nodes are implemented as plug-ins.

The Node infrastructure handles the data transfer between nodes, themanipulation of data (e.g. Splitting of data, Transpose of data etc),memory allocation/de-allocation and parallel execution of Nodes. Thenode infrastructure in-turn uses the Memory manager, Thread pool and theconfiguration module of the platform.

Library module 12 provides a generic interface for the signalprocessing/mathematical libraries which the algorithm encapsulated inthe Nodes can use. Library module is a wrapper over off-the-shelf, 3rdparty libraries like IPP, MKL, APL, NPP etc. Library module providesmechanism to configure the 3rd party library to be used for eachmathematical routine. It is possible to extend the Library module tosupport new 3rd party library without recompiling the applicationsoftware.

The Library module 12 also provides support for GPU libraries like theNPP, CUDA which enables the signal processing routines like the FFT,Convolution, and Correlation etc to be executed on the Graphics card forenhanced performance if the graphics card is available on the system.

The development effort and the complexity of node development may begreatly reduced because of this architecture.

FIG. 3 illustrates various operations performed by each of the plug-insor nodes. In step 16 data is received. Next the data is manipulated andapplied or transformed into a useful form. Next in step 18 the algorithmis applied and the data is sent to the algorithm 19. After the algorithmhas responded the data is returned 20. FIG. 3 illustrates theresponsibilities of each node. The generic part of the node includesreceiving data from previous node, manipulating the data like splittingthe data, transposing the data if required, applying the algorithm andsending the data to the next node [16, 17, 18, 20]. The algorithm [19]that needs to be applied would be different for each node.

FIG. 4 illustrates a node 21 and shows how it is designed to implementthe algorithm 22. Here the generic part of the node is handled in thebase class and the derived class just implements the actual algorithm.Thus the Image processing algorithm developer can concentrate only onthe algorithm development and rest will be handled by the base class.The base class is part of the Node infrastructure layer of platform.

FIG. 5 illustrates how algorithms developed in other languages likeMATLAB can be handled. Here the MATLAB class 24 is a generic class forall algorithms developed in MATLAB. The ManipulateData method of theNode class 23 is overridden to manipulate/convert the data format fromC++ to MATLAB. The ApplyAlgo( ) is again overridden to look at theconfiguration 25 to determine which MATLAB file 26, 27 needs to beexecuted. The ApplyAlgo( ) also handles the conversion of the processeddata from MATLAB format to C++ format. The MATLAB file can be built intobinary using MATLAB compiler to avoid availability of MATLAB on theexecution system. On similar lines algorithms developed in otherlanguages can be handled.

FIG. 6 illustrates the design of a library module. The library functions28 are a collection of mathematical/signal/image processing routinessupported. The configuration file 37 lists for each of the routine which3rd party library is to be used. The configuration file is a text basedfile and any modification here wouldn't require a recompilation of theapplication. As each of the 3rd party library is provided by differentvendors the signature of the same routines is not the same acrossdifferent library and hence a wrapper is provided for each library. Thewrapper 29, 31, 33, 35 acts like an adapter between the genericsignature exposed by the library function 28 and the specific libraries30, 32, 34, 36. It is very difficult to find a single library whichprovides all the mathematical/signal/image processing routines and allof them being efficient. What is found often is some of the routines areefficient in one 3rd party library and others in other 3rd partylibrary. The above mechanism of configuring which 3rd party library touse of a particular routine allows to use the best 3rd party of libraryfor each routine. It is very easy to extend this to support otherlibraries, just a development of a wrapper which adapts each routinesignature from the generic signature to that expected by the 3rd partylibrary.

FIG. 7 illustrates the execution of the reconstructor chain 42 using thethread pool 41 on a multi-core processor computer. The k-space (rawdata) 38 is acquired by the MR scanner 39 each row (Ky) at a time. Asthe row is acquired, it is sent to the reconstructor 43. An input node40 is provided which reads the acquired data one row at a time andcreates a task for each row. The method set for the task is the firstalgorithm (Node) in the reconstruction chain 42. The task created issubmitted to the thread pool 41. The thread pool creates threads equalto the number of cores on the system. This is done to avoid contextswitching. The task execution would start from the first node in thereconstruction chain and keep executing the subsequent nodes in thechain. At certain point in the chain it would be required to have thecomplete k-space data for further processing, a special kind of nodewhich collects all the rows to form a 2d data is to be used in thechain. Once the data is collected this node would again submit a taskwith the collected 2d data to the thread pool with the next nodeprocessing as the task execution method. If the subsequent nodes don'trequire 2D data to work on they can further split the data and createtasks for each split data and submit the task to the thread pool in themanipulate method( ). This will further parallelize the execution.

Examples may provide for a method for efficiently execution of MR imagereconstruction on a multi-core processor with the flexibility of one ormore of the following features:

1. Using image processing algorithms developed in multiple languages ina reconstruction chain.

2. Using efficient off-the-shelf 3rd party libraries and changing themat runtime without recompiling the reconstruction program.

3. Possibility of execution of certain mathematical/signal/imageprocessing routines on the graphics card if available on the systemwithout re-compiling the construction program

4. Dynamically controlling the sequence of image processing algorithmswithout recompiling the reconstruction program.

FIG. 8 illustrates an example of a medical instrument 800. The medicalinstrument 800 comprises magnetic resonance imaging system 802 with amagnet 804. The magnet 804 is a superconducting cylindrical type magnet804 with a bore 806 through it. The use of different types of magnets isalso possible for instance it is also possible to use both a splitcylindrical magnet and a so called open magnet. A split cylindricalmagnet is similar to a standard cylindrical magnet, except that thecryostat has been split into two sections to allow access to theiso-plane of the magnet, such magnets may for instance be used inconjunction with charged particle beam therapy. An open magnet has twomagnet sections, one above the other with a space in-between that islarge enough to receive a subject: the arrangement of the two sectionsarea similar to that of a Helmholtz coil. Open magnets are popular,because the subject is less confined. Inside the cryostat of thecylindrical magnet there is a collection of superconducting coils.Within the bore 806 of the cylindrical magnet 804 there is an imagingzone 808 where the magnetic field is strong and uniform enough toperform magnetic resonance imaging.

Within the bore 806 of the magnet there is also a set of magnetic fieldgradient coils 810 which is used for acquisition of magnetic resonancedata to spatially encode magnetic spins within the imaging zone 808 ofthe magnet 804. The magnetic field gradient coils 810 connected to amagnetic field gradient coil power supply 812. The magnetic fieldgradient coils 810 are intended to be representative. Typically magneticfield gradient coils 810 contain three separate sets of coils forspatially encoding in three orthogonal spatial directions. A magneticfield gradient power supply supplies current to the magnetic fieldgradient coils. The current supplied to the magnetic field gradientcoils 810 is controlled as a function of time and may be ramped orpulsed.

Adjacent to the imaging zone 808 is a radio-frequency coil 814 formanipulating the orientations of magnetic spins within the imaging zone808 and for receiving radio transmissions from spins also within theimaging zone 808. The radio frequency antenna may contain multiple coilelements. The radio frequency antenna may also be referred to as achannel or antenna. The radio-frequency coil 814 is connected to a radiofrequency transceiver 816. The radio-frequency coil 814 and radiofrequency transceiver 816 may be replaced by separate transmit andreceive coils and a separate transmitter and receiver. It is understoodthat the radio-frequency coil 814 and the radio frequency transceiver816 are representative. The radio-frequency coil 814 is intended to alsorepresent a dedicated transmit antenna and a dedicated receive antenna.Likewise the transceiver 816 may also represent a separate transmitterand receivers. The radio-frequency coil 814 may also have multiplereceive/transmit elements and the radio frequency transceiver 816 mayhave multiple receive/transmit channels.

The magnetic field gradient coil power supply 812 and the transceiver816 are connected to a hardware interface 828 of computer system 826.The computer system 826 further comprises a processor 830. The processor830 is connected to the hardware interface 828, a user interface 832,computer storage 834, and computer memory 836. The contents of thecomputer storage 824 and the computer memory 836 may duplicate eachother or elements shown in one may be alternatively located in theother.

The computer storage 834 is shown as containing pulse sequence data 840.The computer storage 834 is further shown as containing magneticresonance data 842. The computer storage 834 is further shown ascontaining a magnetic resonance image 844.

The computer memory 836 is shown as containing a control module 850. Thecontrol module 850 contains computer-executable code which enables theprocessor 830 to control the operation and function of the medicalinstrument 800. For instance the control module 850 may use the pulsesequence data 840 to acquire the magnetic resonance data 842. Thecomputer memory 836 is further shown as containing a magnetic resonancedata processing application 852. The magnetic resonance data processingapplication 852 uses plug-ins to reconstruct the magnetic resonanceimage 844 from the magnetic resonance data 842. The computer memory 836is further shown as containing a numerical library 854 which contains atleast one library of numerical algorithms and each library implements atleast one numerical algorithm.

The computer memory 836 is further shown as containing a plug-in wrapperlibrary 856. The plug-in wrapper library 856 provides a wrapper for eachof the algorithms in the numerical library 854 so they can beimplemented as plug-ins. The computer memory 836 is further shown ascontaining a plug-in wrapper library 856. The first selection ofplug-ins 858 is a selection of plug-ins implemented by the plug-inwrapper library 856. The computer memory 836 is further shown ascontaining a protocol definition interface 860 which controls theloading of the first selection of plug-ins 858 into the magneticresonance data processing application 852.

FIG. 9 shows a flowchart which illustrates a method of operating themedical instrument 800 of FIG. 8. First in step 900 the magneticresonance data processing application 852 is executed thereby providinga plug-in framework. Next in step 902 the protocol definition interface860 is executed to load a first selection of the plug-ins 858 into theplug-in framework. Next in step 904 the magnetic resonance data 842 isacquired by using the pulse sequence data 840 to control the magneticresonance imaging system 802. Finally in step 906 the magnetic resonanceimage 844 is reconstructed from the magnetic resonance data 842 usingthe first selection of the plug-ins 858.

FIG. 10 shows a further example of a medical instrument 1000. Themedical instrument 1000 is similar to that shown in FIG. 8 except themedical instrument further comprises an additional high-intensityfocused ultrasound system 1002. The high-intensity focused ultrasoundsystem 1002 is intended to be representative. The high-intensity focusedultrasound system could also be for example replaced with a gamma knife,a LINAC, an x-ray treatment system, a charged particle accelerator, orother type of external beam radiotherapy system.

The high-intensity focused ultrasound system 1002 comprises afluid-filled chamber 1004 which houses an ultrasound transducer 1006.The ultrasound transducer 1006 is mechanically positioned by amechanical positioning system 1008. There is an actuator 1010 foractuating the mechanical positioning system. In alternative embodimentsthe ultrasound transducer may be a manually positioned externaltransducer without the fluid-filled chamber 1004 or mechanicalpositioning system 1008.

The ultrasonic transducer 1006 may also contain multiple elements foremitting ultrasound. A power supply which is not shown may control theamplitude and/or phase and/or frequency of alternating current electricpower supplied to the elements of the ultrasonic transducer 1006. Thedashed lines 1012 show the path of ultrasound from the ultrasonictransducer 1006. The ultrasound 1012 first passes through thefluid-filled chamber 1004. The ultrasound then passes through anultrasound window 1014. After passing through the ultrasound window 1014the ultrasound passes through an optional gel pad 1016 or a layer ofultrasound conductive gel which may be used to conduct ultrasoundbetween the window 1014 and the subject 818. The ultrasound 1012 thenenters the subject 818 and is focused into a focus 1018 or sonicationpoint. There is a region 1020 which is a target zone. Through acombination of electronic and mechanical positioning of the focus 1018the entire target zone 1020 can be heated. The target zone 1020 iswithin the imaging zone 808. The high-intensity focused ultrasoundsystem 1002, the transceiver 816, and the magnetic field gradient coilpower supply 812 are all connected to a hardware interface 828 ofcomputer system 826.

The computer storage 834 is shown as additionally containing treatmentplan data 1030 that has been received from an external computer, storagedevice, or from the user interface 832. The computer storage 834 isshown as further containing a thermal map 1032 that has beenreconstructed from the magnetic resonance data 842. For instance thepulse sequence data 840 could contain instructions for acquiring thermalmagnetic resonance data. The computer storage 834 is shown as furthercontaining treatment system control commands 1034 which were generatedusing the thermal map 832 and the treatment plan data 1030.Alternatively the magnetic resonance image 844 could also be used. Forinstance the movement of the subject 818 could be tracked as well asmaking a thermal map of how the subject 818 is being heated inside.

The computer memory 836 is shown as additionally containing a secondselection of plug-ins which contain additional algorithms for processingthe magnetic resonance data 840 or magnetic resonance image 844 orthermal map 1032. The second selection of plug-ins 1040 uses data togenerate the treatment system control commands 1034. The treatmentsystem control commands 1034 enable the processor 830 to control thehigh-intensity focused ultrasound system 1002 via the hardware interface828.

FIG. 11 shows a flow diagram which illustrates a method of operating themedical instrument 1000 of FIG. 10. First step 900 as described in FIG.9 is performed. Next step 902 as described for FIG. 9 is performed. Nextstep 1100 treatment plan data 1030 descriptive of commands forcontrolling the treatment system to direct energy at the target zone1020 is received. Next in step 1102 a second selection of plug-ins 1040operable for generating the treatment system control commands 1034 areloaded. Next step 904 as described for FIG. 9 is performed. Next step906 as described for FIG. 9 is performed. Then next in step 1104treatment system control commands 1034 are generated using the secondselection of the plug-ins 1040 and the treatment plan data 1030 with thethermal map 1032 and/or the magnetic resonance image 844.

Next step 1106 is performed where the treatment system or in this casethe high-intensity focused ultrasound system 1002 is controlled usingthe treatment system control commands 1034. The method then proceeds toa decision box 1108 where the question is the treatment finished. If thetreatment is finished then the method proceeds to step 1110 and themethod described in FIG. 11 ends. If the answer is no the treatment isnot yet finished, then the method goes back to step 904 and the steps904, 906, 1104 and 1106 are repeated until the treatment is finished.These steps form a closed control loop and the first selection ofplug-ins 858 and the second selection of plug-ins 1040 are used forcontrolling the high-intensity focused ultrasound system 1002 using themagnetic resonance data 842.

FIG. 12 illustrates a framework 1200 for implementing examples of amagnetic resonance data processing system. The framework 1200 comprisesa platform 1202 and a development environment 1204. The platform 1202comprises a foundation 1206. The foundation 1206 handles complexsoftware engineering aspects such as threading, memory management, taskscheduling, and other tasks. This is so that the reconstruction can makeoptimum use of the hardware. The platform 1202 also comprises a protocoldefinition interface which provides a Ruby infrastructure forinstantiating and connecting the processing steps to each other in areconstruction chain. Other languages than Ruby may be used also. Theplatform 1202 also contains a node interface 1210. The node interfaceenables data transfer across different steps in the reconstructionprocess by providing a completely modular, programmable interface. Thenode interface may also be referred to as the plug-in framework. Theframework 1200 also comprises a library interface 1212. The libraryinterface is a wrapper of a commercial or other libraries for performingnumerical operations and exposes a simple, possibly intuitive interfacefor using the functions available in commercial libraries.

The development environment may contain modules which are adaptable anduseful for clinical research and development. The developmentenvironment 1204 comprises a protocol definition 1214. This protocoldefinition 1214 may be a Ruby environment where the logic is used tocreate the nodes as implemented. Using a protocol definition script thebehavior of the nodes can be configured and/or their execution changed.Reconstruction of images apply numerous independent processing steps inthe raw data received from the scanner. In the proposed architecture,these processing steps have been designed as independent software unitscalled nodes. The nodes may also be referred to as plug-ins. As a nodetherefore as a small independent software unit in the reconstructionchain which can be used to process the image data. The developmentenvironment 1204 further comprises a library module 1218. The librarymodule may be wrapped over commercial libraries or other numericallibraries. Researchers can use the routines in any of these libraries orimplement their own versions of the routines. The modules may alsosupport GPU libraries. If a graphics card is available on the system thesingle processing routines like FFT convolution, and correlation orothers can be executed on the graphics card itself, resulting in anenhanced performance.

Examples may provide a one-stop image reconstruction or data processingframework designed to decouple the entire software engineering (memorymanagement, scheduling, execution time etc.) from the reconstructionlogic. The framework not only insulates the researcher from the softwareengineering layers, but also provides a plug-and-play environment readyfor introducing new algorithms.

Examples may provide a development environment with an absolutelymodular design. In its transformation from raw data into the finalimage, the data from the scanner passes through a series of completelyindependent processing modules called Nodes. The object oriented, C++interface containing the nodes performs many of the commonreconstruction tasks and lends itself to reuse and reconfiguration.

Examples may simplify adding new algorithms or processing steps toexisting reconstruction chains does not necessitate recompiling thecomplete software. The plug-and-play architecture of the platformensures that introducing a new processing step only requires a simplemodification in the Protocol Definition Script. The new algorithmsdeveloped can also be easily deployed in a clinical workflow.

The architecture defined in examples may be designed for efficientexecution of algorithms on the hardware. It automatically parallelizesthe execution of the algorithms to utilize all the processor/coresavailable in the system, ensuring the performance of the reconstructionmatches that of the hardware. Support for commercial math/signalprocessing libraries

With its Library module, the framework may provides a single programminginterface over commercially available math and signal processinglibraries such as IPP, MKL. Every math or signal processing routine canbe individually configured at runtime without recompiling the software.

The proposed architecture ensures clear separation between the softwareengineering and the development (algorithm) environments.

The major building blocks of examples may comprise one or more of thefollowing elements:

A. Platform—The Foundation handles complex software engineering aspectssuch as threading, memory management, task scheduling etc. so that thereconstruction can make optimum use of the hardware.

B. The Protocol Definition Interface provides the Ruby infrastructurefor instantiating and connecting the processing steps to each other in areconstruction chain. The Node Interface enables data transfer acrossdifferent steps in the reconstruction process by providing a completelymodular, programmable interface.

C. The Library Interface is a wrapper over commercial libraries andexposes a simple, intuitive interface for using the functions availablein commercial libraries. The Development Environment contains thosemodules which are adaptable for clinical research and development.

D. Protocol Definition is a Ruby environment where the logic to identifyand instantiate the Nodes is implemented. Using the Protocol DefinitionScript, the behavior of the Nodes can be configured and/or their orderof execution changed.

Reconstruction involves applying numerous independent processing stepson the raw data received from the scanner. In the proposed architecture,these processing steps have been designed as independent software unitscalled Nodes. A Node therefore, is the smallest independent softwareunit in the reconstruction chain which can process the image data.

E. The Library module is a wrapper over commercial libraries such asIPP, MKL, APL and NPP. Researchers can use the routines in any of theselibraries or implement your own versions of the routines. The modulealso supports GPU libraries like NPP, CUDA etc. When the graphics cardis available on the system, the signal processing routines like FFT,Convolution, and Correlation etc. can be executed on the graphics carditself, resulting in enhanced performance.

FIG. 13 shows a flowchart which illustrates a method of adding a newnode or plug-in to the system. The method starts in step 1300. In step1302 a node specification is received and a node C++ file is created instep 1304. This results in C++ files and configuration files beingcreated 1306. Next in step 1308 a configuration is added. Next in step1310 the node or plug-in is implemented. Next in step 1312 the node isbuilt. This results in the node binaries 1314 being outputted. In step1316 an initial reconstruction graph is received. The initialreconstruction graph is equivalent to the protocol definition interfacebeing executed. This is then used to modify the protocol definition1318. This results in a final reconstruction graph 1320 being outputted.Next in step 1322 the particular configuration is added to the systemand the method ends or stops in step 1324.

Examples may also be used to control or drive additional hardware whichcan be used for therapy applications for example. Such a model wouldlook as described in FIGS. 14 and 15.

FIG. 14 shows a reconstruction graph or the sequence is used toreconstruct a magnetic resonance image for a diagnostic magneticresonance imaging system. First in step 1400 k-space data is receivedfrom the scanner or magnetic resonance imaging system. Next 1402 acorrection is applied. Next in step 1404 a Fourier transform isperformed. Next in step 1406 image production is performed or the imageis reconstructed. Next in step 1408 the image is scaled. Finally in step1410 the image is written to a database.

FIG. 15 shows how this chain may be modified so that the data may beused for controlling a magnetic resonance imaging system. After step1408 the data is used to calculate a temperature map in step 1500. Nextthis is sent to a device drive 1502 which is used to control ahigh-intensity focused ultrasound system 1504. This adds support formagnetic resonance guided therapy. There could be certain maps needed tobe computed and sent to a device driver 1502 which would then drive theexternal hardware 1504. The graph changes would only be an introductionof a new algorithm step or node for computation of the map in thetriggers for the device driver with the appropriate data. In thisarchitecture this would mean development of a new node copying the newnode binaries to the reconstructor, modification of the graph, a coupleof line changes and then addition of a hardware.

To add support for MR guided Therapy, where certain Maps need to becomputed and sent to a device driver which would then drive the externalhardware (outside of the reconstructor), the graph changes would be onlyan introduction of new algorithm step (Node) for computation of the Mapand triggers the device driver with the appropriate data. In this newproposed architecture this would mean development of a new Node, copyingof the new Node binaries to Reconstructor, modification of the graph (acouple of line changes) and then addition of hardware. The new modifiedgraph would look like FIG. 15.

While the invention has been illustrated and described in detail in thedrawings and foregoing description, such illustration and descriptionare to be considered illustrative or exemplary and not restrictive; theinvention is not limited to the disclosed embodiments.

Other variations to the disclosed embodiments can be understood andeffected by those skilled in the art in practicing the claimedinvention, from a study of the drawings, the disclosure, and theappended claims. In the claims, the word “comprising” does not excludeother elements or steps, and the indefinite article “a” or “an” does notexclude a plurality. A single processor or other unit may fulfill thefunctions of several items recited in the claims. The mere fact thatcertain measures are recited in mutually different dependent claims doesnot indicate that a combination of these measured cannot be used toadvantage. A computer program may be stored/distributed on a suitablemedium, such as an optical storage medium or a solid-state mediumsupplied together with or as part of other hardware, but may also bedistributed in other forms, such as via the Internet or other wired orwireless telecommunication systems. Any reference signs in the claimsshould not be construed as limiting the scope.

LIST OF REFERENCE NUMERALS

-   -   1 image processing chain    -   2 raw image    -   3 processed image    -   4 algorithm 1    -   5 algorithm 2    -   6 algorithm 3    -   7 algorithm 4    -   8 implementation of magnetic resonance data processing        application    -   9 algorithm 1    -   10 algorithm 2    -   11 algorithm 3    -   12 numerical library    -   13 configuration    -   14 thread pool    -   15 memory manager    -   16 receive data    -   17 manipulate data    -   18 apply algorithm    -   19 implementation of algorithm    -   20 send or return data    -   21 node    -   22 algorithm    -   23 node class    -   24 matlab node    -   25 configuration    -   26 matlab file    -   27 matlab file    -   28 library function    -   29 plug-in wrapper    -   30 numerical algorithm library    -   31 plug-in wrapper    -   32 numerical algorithm library    -   33 plug-in wrapper    -   34 numerical algorithm library    -   35 plug-in wrapper    -   36 numerical algorithm library    -   37 configuration file    -   38 k-space data or magnetic resonance data    -   40 input node    -   41 thread pool    -   42 reconstructor chain of plug-ins    -   43 reconstrutor    -   800 medical instrument    -   802 magnetic resonance imaging system    -   804 magnet    -   806 bore of magnet    -   808 imaging zone    -   810 magnetic field gradient coils    -   812 magnetic field gradient coil power supply    -   814 radio-frequency coil    -   816 transceiver    -   818 subject    -   820 subject support    -   826 computer system    -   828 hardware interface    -   830 processor    -   832 user interface    -   834 computer storage    -   836 computer memory    -   840 pulse sequence data    -   842 magnetic resonance data    -   844 magnetic resonance image    -   850 control module    -   852 magnetic resonance data processing application    -   854 numerical library    -   856 plug in wrapper library    -   858 first selection of plug-ins    -   860 protocol definition interface    -   900 execute the magnetic resonance data processing application        thereby providing the plug-in framework    -   902 execute the protocol definition interface to load a first        selection of the plug-ins into the plug-in framework;    -   904 acquire the magnetic resonance data by using the pulse        sequence data to control the magnetic resonance imaging system    -   906 reconstruct a magnetic resonance image from the magnetic        resonance data using the first selection of the plug-ins    -   1000 medical instrument    -   1002 high intensity focused ultrasound system    -   1004 fluid filled chamber    -   1006 ultrasonic transducer    -   1008 mechanical positioning system    -   1010 actuator    -   1012 path of ultrasound    -   1014 ultrasound window    -   1016 gel pad    -   1018 focus    -   1020 target zone    -   1030 treatment plan data    -   1032 thermal map    -   1034 treatment system control commands    -   1040 second selection of plug-ins    -   1100 receive treatment plan data descriptive of commands for        controlling the treatment system to direct energy at the target        zone    -   1102 load a second selection of the plug-ins operable for        generating treatment system control commands using the magnetic        resonance image and the treatment plan data    -   1104 generate the treatment system control commands using the        second selection of the plug-ins    -   1106 control the treatment system using the treatment system        control commands    -   1200 framework    -   1202 platform    -   1204 development environment    -   1206 foundation    -   1208 protocol definition interface    -   1210 node interface    -   1212 library interface    -   1214 protocol definition    -   1216 nodes or plug-ins    -   1218 library    -   1300 start    -   1302 node specification input    -   1304 create node cpp file    -   1306 cpp files and configuration files output    -   1308 add configuration    -   1310 implementing the node    -   1312 build node    -   1314 output node binaries    -   1316 input initial reconstruction graph    -   1318 modify protocol definitions    -   1320 output final reconstruction graph    -   1322 add configuration    -   1324 stop    -   1400 receive k-space data    -   1402 apply correction    -   1404 Fourier transform    -   1406 image production    -   1408 scale    -   1410 write to database    -   1500 calculate temperature map    -   1502 device driver    -   1504 external treatment system

The invention claimed is:
 1. A medical instrument comprising: a magneticresonance imaging system for acquiring magnetic resonance data from animaging zone; a memory containing: machine executable instructions, amagnetic resonance data processing application, pulse sequence data, atleast one numerical algorithm library, a plug-in wrapper libraryconfigured for providing the least one numerical algorithm library asplug-ins, and a protocol definition interface; wherein the at least onenumerical algorithm library comprises machine executable code forperforming at least one numerical algorithm; wherein the magneticresonance data processing application is configured for implementing aplug-in framework for numerical processing of the magnetic resonancedata; wherein the protocol definition interface is configured forcontrolling the loading of the plug-ins and the execution order of theplug-ins; and at least one processor for controlling the medicalinstrument, wherein execution of the instruction cause the at least oneprocessor to: execute the magnetic resonance data processing applicationthereby providing the plug-in framework; execute the protocol definitioninterface to load a first selection of the plug-ins into the plug-inframework; acquire the magnetic resonance data by using the pulsesequence data to control the magnetic resonance imaging system; andreconstruct a magnetic resonance image from the magnetic resonance datausing the first selection of the plug-ins.
 2. The medical instrument ofclaim 1, wherein the medical instrument further comprising a treatmentsystem for directing energy at a target zone within the imaging zone,wherein execution of the instructions further cause the processor toreceive treatment plan data descriptive of commands for controlling thetreatment system to direct energy at the target zone, wherein executionof the instruction cause the protocol definition interface to furtherload a second selection of the plug-ins operable for generatingtreatment system control commands using the magnetic resonance image andthe treatment plan data, wherein execution of the instructions furthercause the processor to repeatedly: acquire the magnetic resonance dataand reconstruct the magnetic resonance image using the first selectionof the plug-ins; generate the treatment system control commands usingthe second selection of the plug-ins, and control the treatment systemusing the treatment system control commands.
 3. The medical instrumentof claim 2, wherein the treatment system is a high intensity focusedultrasound system.
 4. The medical instrument of claim 3, wherein themagnetic resonance image comprises a temperature map.
 5. The medicalinstrument of claim 2, wherein the treatment system is an external beamradiotherapy system for irradiating the target zone with a beam ofionizing radiation.
 6. The medical instrument of claim 5, wherein theexternal beam radiotherapy system is any one of the following: a gammaknife, a LINAC, an X-ray treatment system, and a charged particleaccelerator.
 7. The medical instrument of claim 1, wherein the at leastone processor is two or more processors operable for executing multipleprocessor threads, wherein execution of the instructions cause theprocessor to execute the plug-ins using the multiple processor threads.8. The medical instrument of claim 1, wherein the medical instrumentcomprises at least one graphics processor, wherein magnetic resonancedata processing application is configured for executing at least aportion of the plug-ins using the at least one graphics processor. 9.The medical instrument of claim 1, wherein the at least one numericalalgorithm library is at least two numerical algorithm libraries, whereineach of the at least two numerical algorithm libraries are implementedin different programming languages.
 10. The medical instrument of claim1, wherein the protocol definition interface is configured forcontrolling the loading of the plug-ins and the execution order of theplug-ins using a script.
 11. The medical instrument of claim 10, whereinthe pulse sequence data comprises the script.